Symmetry considerations and development of pinwheels in visual maps 
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Neurons in the visual cortex respond best to rod-like stimuli of given orientation. While the 
preferred orientation varies continuously across most of the cortex, there are prominent pinwheel 
centers around which all orientations are present. Oriented segments abound in natural images, 
and tend to be collinear; neurons are also more likely to be connected if their preferred orientations 
are aligned to their topographic separation. These are indications of a reduced symmetry requiring 
joint rotations of both orientation preference and the underlying topography. We verify that this 
requirement extends to cortical maps of monkey and cat by direct statistical analysis. Furthermore, 
analytical arguments and numerical studies indicate that pinwheels are generically stable in evolving 
field models which couple orientation and topography. 



I 

o 
o 



> 

m 
in 

m 
o 



X3 
O 

o 



X 
J3 



INTRODUCTION 

The preferential response of cells in the primary visual 
cortex to lines of a particular orientation has been known 
for over forty years Q, yet remains a subject of intense 
experimental study and modelling. Early models were 
simple structural arrangements of local iso-orientation 
columns into regular arrays |2, S Q- Intricate maps of 
global patterns of orientationpreference over the cortex, 
obtained by optical imaging[^ revealed more com- 
plex arrangements. Thus, later models focused on the 
development of orientation preference (OP) in networks 
of neurons whose connectivity is modified in response to 
stimuh0, H, 0- Obtaining large scale patterns of OP 
with many pinwheels is computationally costly with the 
latter models drastically simplified models generate 
large static rnaps essentially from bandpass filtered white 
noise mi m [3. 

Analytical understanding of the development of visual 
maps, and its connections to other problems in pattern 
formation, is best obtained in terms of evolving fields. 
In this framework, OP is modelled by a director field 
s = (sx{x,y)^ Sy{x,y)), indicating the preferred orienta- 
tion at location r = {x, y) on the cortex. The field s (r, t) 
then evolves in time according to some development rule 
that depends on its configurations at earlier times 14. 1^. 
Wolf and Geisel (WG) have shownjl^ that a large num- 
ber of such evolutions can be summarized through a dy- 
namical equation dts (r, t) = F [s] . (WG combine the two 
components into a single complex field z = (s^ + isy) .) 
Common elements in models of evolving fields are: 

(a) Starting from an initial condition with little OP, there 
is a rapid onset of selectivity governed by L [s] , the lin- 
ear part of the functional F [s] . The characteristic length 
scale observed in cortical maps is implemented by a lin- 
ear operator that causes maximal growth of features of 
wavelength A, i.e. acting as a 'band-pass filter' in the 
parlance of circuits. It is possible to follow the linear 
development analytically: WG show that the density of 
pinwheels (zeros of the field z(r)) has to be larger than 
tt/A^ in this regime. 



(b) Because the linear evolution leads to unbounded 
growth of OP, nonlinearities are essential for a proper sat- 
uration of the field. Although analytical studies of non- 
linear development are difficult, numerical simulations in- 
dicate that the OP patterns continue to change (albeit 
more slowly) even after their magnitudes have saturated. 
More importantly, the pinwheels typically annihilate in 
pairs, giving way to a rainbow pattern of wavelength A. 
To maintain pinwheels, development has to be stopped, 
or extrinsic elements such as inhomogeneities that trap 
the pinwheels have to be introduced^]. Because the 
neural processes that lead to OP are still not fully un- 
derstood, the stability of pinwheels has not been a topic 
of much study amongst neuroscientists. Nevertheless, the 
search for intrinsically stable pinwheel patterns has moti- 
vated some recent studies 18, 19]. We propose here an al- 
ternative explanation, demonstrating that evolving field 
models with proper rotational symmetry generically lead 
to patterns with stable pinwheels. 

Symmetry considerations are paramount in problems 
of pattern formation. Because all directions are more 
or less equally present in cortical maps, practically all 
models of OP (certainly those summarized in WG) as- 
sume that different orientations are equivalent l20| . The 
full rotational symmetry is implemented by requiring the 
evolution of s (r, t) to be unchanged if all angles are ro- 
tated together. This rotation is independent of the to- 
pographic space r, which is also assumed to be isotropic 
(no preferred directions). Two versions of rotation are 
illustrated in Fig. ^ Figure displays a collection of 
oriented lines that are rotated independently of the back- 
ground grid from Fig. We propose that the appropri- 
ate symmetry for OP maps is simultaneous rotations of 
the orientations and the underlying space, as illustrated 
in Fig. IB;. 

The observational evidence for the reduced symmetry 
is reviewed in Sec. □ As suggested by Fig. the absence 
of full rotation symmetry in natural images is expected, 
and in fact demonstrated in Ref. . There is also an ev- 
idence that neural connectivities are preferentially linked 
along the axis of OPj^^. We present a statistical analysis 
of OP maps from monkey and cat, which also supports 



FIG. 1: a depicts the image of an arrow formed by oriented 
solid lines, on a topographic grid of dotted lines. In b, each 
solid line is rotated anti-clockwise by 45° independent of the 
grid. The thus 'rotated' image bears little resemblance to the 
original. In c, there is simultaneous rotation of the grid and 
the solid lines, as the whole image is rotated. 

the lack of full rotation symmetry. Consequences of re- 
duced symmetry in evolving field models are discussed 
in Sec. „ A linear analysis indicates that the reduced 
symmetry introduces an additional time scale into the 
problem, and an interval in which the pinwheel density 
can actually increase by pair creations. Vectorial versions 
of center-surround interactions are then used in numer- 
ical simulations of model with joint rotation symmetry. 
The simulations result in patterns with intrinsically sta- 
ble pinwheels, and histograms of OP similar to those ob- 
tained from cat and monkey maps. 




FIG. 2: Histograms of OP from a cortical map of monkey, 
a. The relative orientation 2{9i —Oj), between two pixels i 
and j at a distance R, is one argument of the histogram; 
the second is the OP of one point measured relative to the 
line joining the two pixels (at angle 4>ij). Full histograms 
are shown on the left column, while the right column is for 
2{<f)ij -dj) = 0° (solid line) or 90° (dotted line), b and c 
are for short separations of 5 to 10 pixel spacings, and show 
no dependence on the relative angle. By contrast, there is 
a small but clear indication of a coupling to the underlying 
topography in d and e which are taken at distances of 70 to 
75 pixels, comparable to the separations of pinwheels. Such 
dependence indicates the lack of full rotation symmetry in the 
map. 



OBSERVATIONAL EVIDENCE OF REDUCED 
SYMMETRY IN CORTICAL MAPS 

Casual consideration of scenes strongly suggests that 
the persistence of edges of stationary objects (as in 
Fig. 0, or of tracks of moving ones, leads to oriented 
segments that cannot be rotated independent of their 
background. This expectation has been confirmed and 
quantified by statistical tests in Ref. jl^l , where an orien- 
tation was assigned to each pixel of images from the nat- 
ural world. The primary query of Ref. |2]| was the range 
and directionality of correlations in orientation. They 
observed that correlations depend on the relative angles 
in the topographic space, in a manner consistent with a 
collection of circles. 

Since the task of the visual system is to extract infor- 
mation from observed images, it is likely that the neu- 
ral connections that carry out the associated computa- 
tions are influenced by symmetries and anisotropics of the 
natural scenes. Contemplation of the Hebbian rulejj^j 
"neurons that fire together wire together," suggest that 
there should be more connections between neurons whose 
shared OP is coUinear to their topographic separation. 



Indeed, biocytin injections which map the 'horizontal' 
connections of neurons have been combined with optical 
imaging of the primary visual cortex of the tree shrewjl^ ■ 
The connections from an injection site are anisotropic, 
preferentially extended along the axis of OP at the site. 
Although less pronounced, similar anisotropics are also 
observed in maps from monkev|24j and cat. Such con- 
nectivities are incompatible with rotations of OP inde- 
pendent of the underlying topography. A map with all 
OPs rotated by a fixed angle would require a different set 
of horizontal connections. 

To test the hypothesis that cortical maps of OP also 
reflect the reduced rotation symmetry, we undertook sta- 
tistical tests of a map of monkey (in the form of 360x480 
pixels, provided by K. Obermeyer, Technical University 
of Berlin, Berlin). At each point i of the map, there is 
an orientation angle 9i, measured relative to an arbitrary 
axis; two points i and j, separated by a distance R form 
an angle 0^ with the same axis, as indicated in Fig. 
Binning into intervals of 10°, we make joint histograms 
of the form hn [2 {0i - 9j) ,2 {<j),j - dj)]. (The factor of 
two is introduced since the orientation is defined from 
to TT.) The second argument measures the angle rela- 
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tive to the line joining points i and j. If the orientations 
are independent of topography, the histograms should be 
independent of their second argument. This is not the 
case for the monkey histograms shown on the left col- 
umn in Fig. 12 the right column shows cross-sections at 
2{(f>ij — 9j) = 0° and 90° which display maximal con- 
trast for parallel orientations. The larger probability for 
2 — Oj) = 90° does not violate expectations based on 
collinear orientations. This is because we do not know 
the actual topographic axis in our monkey map. The 
choice of an arbitrary axis does not modify 9i — 9j, but 
shifts the histograms along 2 (0^ — 6j). The advantage 
of our method is the ability to detect lack of full rotation 
symmetry in the absence of knowledge of topographic 
axis; but the lack of this information prevents making a 
connection to correlations in visual inputs. 

Figures and Et are at separations R which are a 
fraction of the typical distance between pinwheels, and 
show no indication of any dependence on topography. By 
contrast, Figs.UJi and correspond to values of R com- 
parable to pinwheel separations. There is now a small, 
but distinct dependence on the orientation of the line be- 
tween two points; indicating that the OPs do not follow 
a distribution with full rotational symmetry. Similar re- 
sults were obtained for maps from cat (204x372 pixels, 
provided by M. Sur and J. Schummers, Massachusetts In- 
stitute of Technology, Cambridge), and are available as 
Fig- El in the supporting information. In both cases the 
dependence on the second argument is small (at most 
around 20%), and some assessments of its statistical sig- 
nificance is needed. Since we had access to only one map 
in each case we made an indirect estimate of statisti- 
cal error by constructing an artificial ensemble of 2000 
histograms though random samplings of 2.9% of total 
pixels in the monkey map. (As described in the sup- 
porting information we tested this sampling procedure 
on maps generated by numerical simulations.) From the 
thus included errors bars in Fig. [21:;, we conclude that the 
differences fall outside statistical errors. 



MODELING JOINT ROTATION SYMMETRY 

We believe that the restriction to joint rotation sym- 
metry is an essential aspect of the OP maps, and should 
be incorporated into models and analytical studies. In 
computational models with neural networks ^3 this is 
naturally achieved through the choice of proper training 
set of images. How should this be implemented in analyt- 
ical models of evolving fields? If the inputs to locations 
(such as i and j in Fig. ^ are predominantly parallel, a 
Hebbian interaction between them would evolve to min- 
imize 9i — Oj. If the OP at i is indicated by a vector s^, 
this interaction can be written as J{R) Si-Sj[2^. Such an 
interaction, however, makes no reference to the relative 
orientation 9j — (pij and thus cannot represent a response 



to a preponderance of inputs that are collinear with the 
topographic (unit) vector f^. To account for the latter, 
we could have distinct interactions between components 
of Si and Sj that are parallel or perpendicular to f ij ; the 
difference between them can be represented by a new in- 
teraction of the form K[R) (s^ • Yij) {sj ■ fij)!!^. With 
this distinction, when and Sj are parallel (perpendic- 
ular) to fij, the strength of interaction is J{R) + K{R) 
{J{R)). 

As a specific model, let us assume a set of Si{t), stim- 
ulated by inputs Pi(t), and interactions between them 
that reflect the average activity of Si{t) over previous 
times. The joint activity of and s-,- contributions can 
be decomposed into two components; and s-,- that are 
parallel to f or perpendicular to it. Both cases con- 
tribute to the isotropic interaction 2Jy (t) = [s^ • s^] , 
while the component parallel to f give rise to the in- 
teraction Jij{t) + Kij{t) = [{si ■ Vij) {sj ■ fij)]^^ . In the 
initial stages, the couplings are small and Si(t) merely 
follow the inputs Pi{t). The couplings then evolve to re- 
flect the statistics of inputs: A tendency for the Pi(t) 
and Pj{t) to be parallel leads to a positive Jtj, while if 
and only if these inputs also tend to be collinear, a fi- 
nite Kij is generated. Note that if Kij = 0, we have 
[si ■ Sj]^^ = 2 [(s^ • fy) {sj ■ fij)]^^ due to equal contri- 
bution from Si and Sj parallel to f , and perpendicular to 
f . As the dynamics proceeds further, the increased cou- 
plings could well freeze to a particular pattern. The in- 
teractions then follow suit, and become correlated to the 
frozen orientations. Such a scenario could well account 
for the correlations between OP and connectivity ob- 
served in the tree shrew |23|. Other procedures for obtain- 
ing synaptic couplings from input activities [l^ 113, , 
once generalized to orientations with proper correlations, 
lead to similar results. However, our intention is not to 
promote a particular scenario, but to emphasize that any 
interactions not specifically ruled out by symmetry will 
generically be present. In the following, we shall explore 
some consequences of joint rotation symmetry on evolu- 
tion of the patterns. 



Linear analysis 

To underscore the difference between the two forms of 
rotation symmetry, let us consider the regime of linear 
evolution which is analytically tractable. Due to trans- 
lation symmetry, the problem is simplified in terms of 
the Fourier modes SQ.(q, t) — J (Pxe^'^'^Sa {^,t), where 
a — 1,2 (or x,y) labels the two components of the vec- 
tor s. After Fourier transforming the interactions J{R) 
and K{R) introduced above, the linear evolution equa- 
tion takes the form 

5tSa(q,<)= ^ [J{q)5ai3 + qaqpK{q)]si3{c^,t) . (1) 

/3=1,2 
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Due to the assumed isotropy, the functions J and K only 
depend on the magnitude of the vector q. For example, 
they can be band-pass filters peaked at q = I-k/K, to 
reproduce the power spectrum of cortical maps. In the 
case of full rotation symmetry, invariance of the equations 
under independent rotations of s and r requires K{q) — 
0. However, if s and r can only be rotated together, a 
finite K{q) is possible and should be generically present. 
(One way to see this is that q • s is invariant under joint 
rotations, but not separate rotations of s and r.) 

A finite K{q) mixes the evolution of the two compo- 
nents Si and §2. This mixing can be removed by decom- 
posing the field s into longitudinal and transverse compo- 
nents. For a given q, the longitudinal component is par- 
allel to q, and the transverse component is perpendicular 
to it. Under the action of the linear operator in Eq. 

the two components grow as e['^'^'^^+''^''^^'^]* and e'-^^'?)*. If 
K{q) = (full rotation symmetry) the two modes grow 
at the same rate, over a time scale Ti{q) ^ 1/J{q). Even 
a small K{q) breaks this degeneracy, introducing a sec- 
ond time scale T2(g) ~ l/[q'^K{q)] over which the effects 
of anisotropy become apparent. 

Note that when the two modes grow at the same rate 
{K{q) = 0), an equal superposition to these modes is 
compatible with a rainbow pattern which does not con- 
tain any nodes. (Of course the rainbow is one of many 
possible patterns.) However, K[q) is generically non- 
zero for a joint rotation symmetry, and one of the two 
modes eventually dominates the other. The dominance 
of transverse or longitudinal components increases the 
density of zeros, and is incompatible with rainbow pat- 
terns. We repeated the analysis of WG for the density of 
pinwheels in the linear regime, in the presence of a small 
K{q). The calculation is cumbersome and relegated to 
the supporting information, but the final result for the 
evolution of pinwheel density is depicted in Fig. |31 The 
initial random pattern has a high density which rapidly 
decrease in a time of order ti ^ J (q) ^ to the limit- 
ing value of tt/A^ predicted by WG. This is the case 
for both isotropic(i4r(g) = 0) and anisotropic {K{q) ^ 0) 
cases. However, pinwheel density then goes up by a factor 
of approximately for the anisotropic case on a time 
scale of T2 ^ \<fK (g)] while it remains as tt/A^ for the 
isotropic case. As explained in the supporting informa- 
tion the factor of is the outcome of an approximate 
evaluation of density which is analytically tractable. We 
also performed simulations that confirmed an increase 
in density by a small factor of ~ 1.12. While the in- 
crease in density is small, nonetheless implies (pair) cre- 
ation of pinwheels in the anisotropic phenomenon 
that is absent in the isotropic models. Note that the 
ultimate density ratio between isotropic and anisotropic 
cases is a universal number, independent of the degree 
of anisotropy. The strength of K{q) only dictates the 
time scale over which the density increases, and not its 
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FIG. 3: Schematic depiction of the evolution of the density 
of zeros for isotropic(dark line) and anisotropic (gray line) 
interactions. Anisotropy results in an increase of the density 
of pinwheels in the latter stages of linear regime. The non- 
linear extrapolation is based on simulation results. 



ultimate value. 



Simulations 

While the above arguments from the linear regime 
strongly suggest that joint rotational symmetry promotes 
pinwheel stability, verification of this hypothesis comes 
from simulations of the nonlinear evolution. For the lat- 
ter, {si(i)} was placed on a lattice of points of locations 
Ti, and evolved in time according to 

dtS, = S, (1- I S, |2) 

+ inj) Sj + K{r,j) (s 

], (2) 

j 

where Ty — — has magnitude Ty along the unit vec- 
tor Tij. The nonlinearity appearing in the first term on 
the right hand side stabilizes the magnitude of to unity. 
The linear evolution is governed by a vectorial center- 
surround filter, composed of two parts: (a) A standard 
center-surround filter with positive couplings Jg in a cir- 
cle of size R/2 K and negative values J; in an annulus 
from R/2 to R. (b) Additional couplings in the annular 
region that explicitly depend on orientations relative to 
the lines joining lattice points, and invariant only under 
joint rotations. We employ positive long-range couplings 
K, to mimic the preferential 'horizontal' connectivity of 
co-oriented co-axially aligned receptive fields, as reported 
in Ref. (2lj |. (Similar kinds of anisotropic interactions 
were also employed in a model for dynamics of neural 
activity in the visual cortexji^. The anisotropic cou- 
pling by lateral neural connectivities was also obtained 
and associated with pinwheel structure in Ref.f2^.) 

Simulations are started on an L x L lattice with initial 
values of |si| = 10~^, equally distributed over all angles, 
with Js = 0.01, Ji = -0.0039, and R = 10. As shown 
in Fig. undifferentiated initial conditions quickly de- 
velop into a pattern with pinwheels reminiscent of actual 
maps. Further evolution depends on the symmetry of 



5 




FIG. 4: a The development of a random initial condition by a 
typical center-surround (bandpass) filter leads to a collection 
of pinwheels. The filter used in b has full rotation symmetry 
{K{r) = in Eq. (|5J). In this case the pinwheels annihilate 
in pairs, giving way to a rainbow pattern at long times, c 
By contrast, a model with joint rotation symmetry evolves to 
a stable pattern of pinwheels. This figure was generated by 
the vectorial center-surround filter in Eq. ||5J , with a non-zero 
K{r). 

development rules. Full rotation symmetry with K — 0, 
and the action of (b) above turned off, leads to a rain- 
bow state with no pinwheels at long times, as in Fig. ^p. 
However, reduction of this symmetry by adding interac- 
tions in (b) with K = 0.0039, above eventually results 
in a square lattice of pinwheels, as in Fig. Et. Natu- 
rally, we do not imply that pinwheels in cortical maps 
form a square lattice (various inhomogeneities could eas- 
ily trap these vortices in a distorted arrangement), but 
that they are intrinsically stable under such development 
rules. The precise choice of long-range couplings is not 
important in this regard, and we observed pinwheel pat- 
terns with other types of anisotropic coupling (some also 
available as Fig. [3 in the supporting information). 

Not surprisingly, the anisotropic couplings lead to cor- 
relations between OP and the topographic angles. We re- 
peated the histogram analysis of actual maps with those 
generated by numerical simulations, and some results are 
plotted in Fig. [3 There is no dependence on topogra- 
phy for K = 0, a,s depicted in Figure. 01 which shows 
two relative angle histograms for 2 {(pij — Oj) = 0° and 
2 {(pij — 9j) — 90°. For K ^ 0, there are positive correla- 
tions in relative angles for 2 {(f)ij — Oj) — 0° and negative 
correlations for 2{(j),j - 0j) = 90° [Fig. 03]. The topo- 
graphic dependence is robust , and does not significantly 
depend on the strength of the anisotropic coupling. 



CONCLUSIONS 

Collinearity is a prominent characteristic of line seg- 
ments in natural images. It is reasonable to expect that 
cortical maps of OP reflect a corresponding tendency. A 
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FIG. 5: Histograms of relative angles for 2{(j}ij—9j) = 0° (solid 
line) and 2(<^,;j ~ Qj) = 90° (dotted line) with isotropic(K=0) 
(a) and anisotropic(K=0.0039) (b) interactions. 

basic consequence of the tendency of line segments to 
be collinear is the absence of a full rotation symmetry, 
independent of the underlying topography. We demon- 
strate the lack of full symmetry by analyzing histograms 
of monkey and cat maps. We then explore consequences 
of reduced symmetry on the behavior of evolving fields 
of OP. In the linear regime, we find that the new interac- 
tions allowed generates a new time scale over which the 
pinwheel density can actually increase. Numerical sim- 
ulations confirm that this tendency persists in the non- 
linear regime, resulting in patterns with stable pinwheels. 

While the stability problem of pinwheels in OP maps 
is not widely appreciated, it has been the motivation for 
two other recent studies. In Ref. [l^ a different cou- 
pling between neurons is used based on a 'wiring length 
minimization' principle, while in Ref. fl9] higher order 
non-linearities are employed in place of the stabilizing 
Si I Si p term in Eq. While these models lead to sta- 
ble patterns of pinwheels, they can not account for the 
'anisotropic' features of actual OP maps, as both have 
full rotation symmetry. A potential relation between the 
symmetries and correlations of line segments in natural 
images, and the statistics of OP maps (including stabil- 
ity and arrangement of pinwheels), may provide further 
clues to how visual information is processed by the brain. 
This work was supported by the NSF grant num- 
ber DMR-01-18213. We are grateful to F. Wolf, D. 
Chklovskii, for illuminating discussions, and to M. Sur 
and K. Obermeyer for sharing of their data. 
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SUPPORTING INFORMATION 



Density of Zeros for a Field with Anisotropy 

We consider a field S = {Sx{x,y), Sy{x,y)). Subject to joint rotational invariance of S and r = {x,y), the most 
general Gaussian weight is 



oc exp 



1 [ (Pq 



Sa{q)Si3{-q] 



X-\qf-^+r-\q)[S^^ 



(3) 



where S{q) is the Fourier transform of S{f), A(g) and T{q) are longitudinal and transverse contents of the power 
spectrum, and r(q) = X{q) in an isotropic system. The average density of zeros is obtained from[30j 



s^is) det da^Sp) = (^s{0))) {\dxSx{o)dySy{o) - d.,Sy{o)dySxm) 



(4) 



Here the average can be taken at r = because of translation symmetry. Also, the averages daS are independent, 
because the probability distribution function is invariant under S ^ S -\- C. The first average is easily calculated as 



(2^)2 



'/ (5(0) 

The variance of S{0) is 

[m ■ m 

and by inserting Eq. © to Eq. we get 



(2^)2 



■ exp 



-y(S(0).5(0) 



(5) 



——r {Sa{q)Sa[q )) 
(27rj 



(Pqd?q' 



{2n) 



^{2nrS\q + q') [X{q) + T{q)] , 



Ij^[Hq)+riq)] !dqq[Xiq)+T{q)y 



(6) 



(7) 
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As a first step to calculating the average determinant, we consider 



{d,s^{o)d,Spio)) 



(27r)2 (27r)2 
d'^q 



{^q^){^q■){So.{q)Sp{q')) 



i2ny 
d'^q 
(2^ 



47r 



-qiqj 



qaqp 

g2 



r{q) 



dqq^T{q) 



2 ^ 8 



dqq' {X{q) - T{q)) 



We next rewrite Eq. ^ as 



(8) 



(9) 



where k = J dq q'^ r(g)/(47r), and /i = J dq q^ i^{q) ~ ■''(9))/(167r) is zero in an isotropic system. In the isotropic 
system, each of the four derivatives is an independent variable. However, for /z ^ 0, there are two correlated pairs 



{dxSx,dySy), and {dxSy,dySx)- For the first pair, we have ({dxSx) 



(dySy) 



K + 3fi, whereas for the second 



pair, [{dySxY) = [{dxSyrj = K+n. The cross correlations in each pair are identical, (dxSxdySy) = (dxSydySx) = 
such that the average value of the determinant is zero. 

As a second step toward the calculation of average absolute value of the determinant, we find its probability 
distribution as 



p{d) = {S [d ~ {dxSxdySy - dxSydySx)]) 



duj 
2^' 



giwd / ^iu/{dxS^dySy — d^SydyS^) 



(10) 



As established above, the two factors in the final exponent are independent random elements. The random variables 
daSp = Uap are Gaussian distributed, with covarianccs given by Eq. I^. By inverting the covariance matrix, we can 
construct the probability distribution for {u^p] and then calculate the average 



/^^iUJU^^Uyy ^ 



exp < --^iUxx,Uyy) 



dllxxdUyy 

+ 



(11) 



(The normalization J\f in the denominator is simply the numerator evaluated at w = 0.) Similarly, the second average 
is 



^^-iu^U^yUy,^ = [l + LU^{{k + i^if - /i^) + 2ii0^l] . 

Inserting Eqs. and p2|l into Eq. (|10|l gives the implicit result 

duj e"^'^ 



p{d) 



J 27r [1 _ 2iw/i + a;2(K2 + 2/xk)]2 [1 + 2iuj fi + uj'^ {k'^ + 6^k + 8^2-)]- 
Let us consider the isotropic case, fi = 0. The probability distribution function is 



p{d) 



dcu 



1 



27r 1 + ^2^2 2k 



(12) 



(13) 



(14) 
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from which we obtain 



(Ml) =2/ dx—e 
Jo 



— X j K 



From Eqs. ||7J), and p5|) . average density of pinwheels is then 

1 Jdqq^T{q) 



^ 1 Jdqq^Pjq) 

At: Jdqq{X{q)+T{q)) St: J dqqP{q) ' 



(15) 



(16) 



where P{q) = X{q) + T{q) — 2T{q) is the power spectrum of the field. The above result is smaller by a factor of two 
than that obtained in ref. 31]. However, our calculation was with a vector field, whereas the orientation preference is 
a director field, which is the same if the vector is inverted. To incorporate this feature, ref. [8ll | works with a complex 
field |z(a? je^*^*-^ = {Sx + iSy)^, a procedure that doubles the zeros calculated above for the field {Sx + iSy). This 
factor is not important to us, because we are interested in how the result is modified by anisotropy. 

Performing the integral in Eq. (|13|l for /i 7^ is not an easy task. We note that because (d) = 0, the average of the 
absolute value provides a measure of the width of the probability distribution p{d). A similar measure of the width 
of the distribution that is much easier to calculate is the standard deviation V<(P>. Using standard properties of 
Gaussian distributed variables, the variance of d is calculated as 

(d^) = /^{dxSxdySy ~ dxSydySxf) 

= {{dxSxf) {{dySyf) + 2 {dxSxdySyf + {(OxSyf) {{dySxf) 
-|-2 {OxSyOySx) 2 (dxSxdySy) {OxSyOySx) 

(k + 3^lf + 2/1^ + (k + fif + 2^^ - 2/^2 
= 2k^ + 8fiK+12fi^. (17) 



As measures of the width of the distribution, (|d|) and \/{<P) should vary together. For our estimate, we shall assume 
that they are proportional and choose a proportionality constant that makes the two expressions equal for = 0; i.e., 
we make the replacement 



(Ml) 



fup) 



resulting in the density of zeros 



Using the expressions for k and /i, we note that 



1 



K + 2fi = ^ I dqq^ 
47r 



jdqq{\{q)+T{q)) 



= ^ / dqq'P{q). 



where P{q) = \{q) + T{q) is the total power content at q. With the aid of Eq. (|20|l . Eq. 11911 now becomes 



V%+W+(2mF _ I !dqq^ P{q) 



JdqqPiq) 



St: JdqqPiq) 



Jdq g3 (A(g)-r(g)) 
Jdqq^ {X{q)+T{q)) 



(18) 



(19) 



(20) 



(21) 



For a fixed P{q), the density of zeros is minimum in the isotropic limit of r(g) = X{q). In the extreme anisotropic 
limit of r(q) = or X{q) = 0, the density of zeros increases by a factor of ^/2. In view of the approximations involved, 
we also performed numerical simulations to check whether the density of pinwheels is higher in the anisotropic case. 
We found that this is indeed the case, although the relative increase in density of 1.12 is less than the value of V2. 

Let us illustrate the time evolution of the density of zeros, using a simple linear model for development of the field, 
in which the longitudinal and transverse components of the power spectrum grow as 



Xiq,t) 
T{q,t) 



Xoiq) e'^'(') \ 
Mq) e--'^^) *, 



(22) 
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where growth rates are ri{q) = 2[J{q) + q^K{q)] and rt{q) = 2J{q). If initially Xoiq) = To{q) = Pq/2, for q < (/max, 
i.e., an isotropically random initial condition, the density of zeros starts as 

n{t = 0) « Y^^gLx- (23) 

As time goes on, modes with the largest growth rate dominate, reducing n through pair annihilations. Assuming 
small anisotropy, such that ri{q) rt{q) — '2,J{q) with a maximum at q = 27r/A, we have 

n(i>(2J(,))-).i-,-.^. (24) 

However, because of small anisotropy {ri{q) =^ rt{q)), one of these nearly degenerate modes will dominate the other, 
such that for longer times, 

n{t>i2q^Kiq))-') « l.fV2=^V2. (25) 

Fig. 3 shows schematic evolution of n for isotropic and anisotropic cases, the increase of the density in the latter must 
also involve creation of pairs of vortices. 
Cortical Map of Cat 

We also measured joint histograms, hf{{2(9i — 6j), 2{(j)j — 9j)], for the map of cat in a manner similar to the monkey. 
The size of the cat map is 204x372 pixels, each representing a region of linear size 13 ^m. As in the case of monkey 
map, we display histograms for short separations of 5-10 pixel spacings [Figs. 6a and b] and separations comparable 
to pinwheel separations of 55-60 [Figs. 6c and d]. There is no dependence on the relative angle for short distances, 
but such a dependence appears on distances comparable to pinwheel separations. This again indicates a lack of full 
rotation symmetry in the map of cat. To estimate errors, we average > 2,000 histograms, each of which is constructed 
by random samplings with 2.9% pixels of the cat map. 




FIG. 6: Histograms of OP from a map of cat. Here 6i{6j) is the preferred orientation at a pixel and <j)ij is the angle of the 
line joining points i and j. The left column displays full histograms as functions of relative orientations, as well as orientations 
relative to the line joining the two pixels i and j. In the right column, solid lines represent histograms for 2(0ij — 9j) — 0°, and 
dotted lines represent histograms for 2{<f)ij — 9j) — 90°. a and b correspond to separations of 5-10 pixel spacings and c and d, 
to separations of 55-60 pixels. 
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Pinwheel Patterns with Various Anisotropic Couplings 

Because we do not claim to know the precise form of interactions that lead to cortical patterns, we should at least show 
that our conclusions are not sensitive to specific choice of interactions. We tested a variety of long-range interactions 
in our numerical simulations and found that pinwheels are generally present in the presence of anisotropy. As an 
example, we observe a pinwheel pattern with a negative value of K, which is used to generate the map in Fig. 7a. 
Another potential concern is that in our simulations, the orientations are represented by a vector, whereas in actuality 
they should be modeled by a director field (vectors without arrows). We also performed simulations in which all angles 
were explicitly limited to the range from to tt. Fig. 7b displays the result of such a simulation, once more resulting 
in a pinwheel pattern (for interaction strength oi K — 0.0039). 




a b 

FIG. 7: a. Stable pattern of pinwheels with joint rotation symmetry, with a negative value of K — —0.0039. (Compare with 
Fig. 4c of the manuscript.) b. A pinwheel pattern is also generated in simulations where the angles are constrained to the 
region of [0,7r]. 



The type of anisotropy introduced above, which couples rotations of orientation and topography, should not be 
confused with the anisotropy corresponding to preference for a particular direction. In fact, we find that both maps 
of monkey and cat show a predominance of certain orientations. The histogram of orientations for monkey is shown 
in Fig. 8a and for cat, in Fig. 8b. 




FIG. 8; Predominance of certain orientation in the maps of monkey (a) and cat (b). All orientations are not equally present 
in either map. 

We test the possibility of stabilizing pinwheels with this form of anisotropy by numerical simulations in models 
with a preference for the horizontal direction, using the time evolution 

dtSi = s, (1- I s, p) + ^ [J (ry ) Sj + K (ry ) {sj ■ ) ry] + H, (26) 
j 

where H = H^x. Introducing the predominance of certain orientation does not change the outcomes. We still find that 
K{rij) = 0, and preference for the horizontal direction with = 0.1, results in a rainbow state with no vortices, as 
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depicted in Fig. 9a. We obtain a lattice of pinwheels by adding interactions Kijij) = Ji with =0.1 [Fig. 9b]. The 
pinwheels are thus stabiUzed not by the preference for a particular angle but by the reduced symmetry of combined 
rotations of orientations and the visual field. 



^ I 




FIG. 9: a. The development of a random initial condition by a filter with isotropic pair interactions {K{rij) = 0), but with a 
preference for the horizontal direction {Ha: = 0.1). Such preference does not stabilize the pinwheels. b. The stabilized pinwheel 
pattern with anisotropic pairwise interactions {K{rij) = —0.0039), in addition to a preference for the horizontal direction 
{Ha: = 0.1). 



Error Estimation for Histograms of Orientation Preference 

We estimate error bars in Fig. 2c and e by averaging > 2,000 histograms. Each histogram is calculated by random 
sampling 2.9 % of total pixels in the monkey map. We then tested that this artificial sampling procedure does not 
lead to spurious effects due to finite-size and other potential factors by applying it to numerically generated maps. 
For the latter, we generated random pinwheel patterns through superposition of isotropic Fourier modes having the 
same longitudinal and transverse components. To do so, we obtain the orientation at position (i, j) by 2D Fourier 
transformation of Sa{q){i,j) = exp(ci + C2q^ — c^q'^) exp{i^a,i,j), where a = x or y and ^a,i,j is a random variable 
ranging from to 2tt. Fig. 10 displays such an isotropic pattern with 256x256 pixels, with a pinwheel density close 
to that of the monkey map. The angle histograms from the isotropic pattern for 2 {(pij — Oj) = (red line) and 
2 ^ Oj) = 90 (black line) are shown in Fig. 10b. We construct histograms for the isotropic pattern with larger size 
(512x512) than the monkey map(360x480) (Fig. 10c). Here error bars in Fig. 10b and c are estimated by averaging 
> 2,000 histograms. As in the analysis for the monkey map, each histogram is constructed by randomly sampling 
2.9% of total pixels in one pattern. The difference between two histograms for 2 (0^ — 9j) = and 2 {(j>ij — 9j) = 90 
from the monkey map is larger than the histogram differences from both isotropic patterns with sizes 256x256 and 
512x512. Hence we have some confidence that observed couplings of relative orientation to the underlying topography 
in the monkey map are not from statistical errors. 
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FIG. 10: a. A pinwheel pattern randomly generated by superposition of isotropic Fourier modes. The size of the pattern is 
256x256 pixels. The relative angle histograms for 2{(j}ij — — 0° (black) and 2{(j>ij — — 90° (red) from patterns with 
sizes of 256x256 (b) and 512x512 (c). Here error bars are estimated by averaging > 2,000 histograms. Neither pattern shows 
comparable topographic dependence to that in the monkey map. 



